Empirical evidence of the limits of automatic assessment of fictional ideation
نویسندگان
چکیده
Automatic evaluation of fictional ideation systems and their output is a topic relevant to Computational Creativity. Models and techniques have been proposed for this task, but their applicability is limited to the field of fictional ideation. In this paper we describe an evaluation procedure for fictional ideation, which compares human validation of the ideas with a number of automatically generated metrics obtained from them. We report on the observed limits of this procedure. The results suggest that, besides technical limitations, providing a stable evaluation method is fundamentally incomplete unless the full creative phenomenon is modelled, including aspects that are beyond current technical capabilities.
منابع مشابه
Reliability Assessment of Shallow Domes Using a Semi-Empirical Evaluation Procedure
Like other structures, shallow domes have imperfections from the prescribed values obtained by specifications during the construction process. Specifications define some tolerance values for imperfections. Despite consideration of these values, the critical load of a dome varies for each imperfection pattern. So the reliability plays an important role in domes safety. Theoretical evaluation pro...
متن کاملA Contrastive Study of Theme in English and Azerbaijani Turkish Fictional Texts
Thematisationis one of the troublesome areas both for translation purposes from or into English and also for learning EFL. The main reason for the problem lies in the fact that usually different languages structure thematisation in different ways. Therefore, the present research is an attempt to investigate contrastively: experiential (topical), interpersonal and textual themes in a sample of A...
متن کاملThe Effectiveness of Adolescent-centered Mindfulness Training and Cognitive Behavioral Therapy on Depression and Suicidal Ideation in Adolescent Girls With Bipolar II Disorder
Background: Cognitive behavioral therapy has provided the most empirical evidence concerning the treatment of mood disorders, especially depression. However, the findings have not confirmed the definitive efficacy of this treatment so far. Objectives: This study aimed to compare the effectiveness of adolescent-centered mindfulness training with cognitive behavioral therapy on depression and su...
متن کاملInfusing Humor in Unexpected Events
In this paper, we focus on humor facilitators, a type of humorous agents meant to act as mediators between unexpected events occurring in smart environments and the human agents. More specifically, we present a case study in which fictional ideation and narrative dramatization are combined to achieve humor facilitation. We implemented a test bed for the simulation of an interactive environment....
متن کاملTowards the Automatic Generation of Fictional Ideas for Games
The invention of fictional ideas is often a central process in the creative production of artefacts such as poems, music, paintings and games. Currently, fictional ideation is being studied by the Computational Creativity community within the WHIM European project. The aim of WHIM is to develop the What-If Machine, a software system capable of inventing, evaluating and presenting fictional idea...
متن کامل